Pandas Profiling Report

Dataset statistics

Number of variables	16
Number of observations	27763
Missing cells	14882
Missing cells (%)	3.4%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	3.4 MiB
Average record size in memory	128.0 B

Variable types

Numeric	16

Alerts

`total_mdd_time` is highly correlated with `m6_mdd_time`	High correlation
`m6_p_earning_days` is highly correlated with `m6_con_rise_days` and 6 other fields	High correlation
`m6_mdd_time` is highly correlated with `total_mdd_time`	High correlation
`m6_con_rise_days` is highly correlated with `m6_p_earning_days` and 4 other fields	High correlation
`year_p_earning_days` is highly correlated with `m6_p_earning_days` and 1 other fields	High correlation
`m3_p_earning_days` is highly correlated with `m6_p_earning_days` and 5 other fields	High correlation
`m3_con_rise_days` is highly correlated with `m6_p_earning_days` and 4 other fields	High correlation
`m3_con_fall_days` is highly correlated with `m3_n_earning_days`	High correlation
`y1_p_earning_days` is highly correlated with `m6_p_earning_days` and 4 other fields	High correlation
`m3_n_earning_days` is highly correlated with `m6_p_earning_days` and 5 other fields	High correlation
`total_con_fall_days` is highly correlated with `total_n_earning_days`	High correlation
`total_n_earning_days` is highly correlated with `total_con_fall_days` and 1 other fields	High correlation
`total_p_earning_days` is highly correlated with `total_n_earning_days`	High correlation
`y1_n_earning_days` is highly correlated with `m6_p_earning_days` and 2 other fields	High correlation
`m6_p_earning_days` is highly correlated with `year_p_earning_days` and 6 other fields	High correlation
`m6_con_rise_days` is highly correlated with `m3_con_rise_days`	High correlation
`year_p_earning_days` is highly correlated with `m6_p_earning_days` and 6 other fields	High correlation
`m3_p_earning_days` is highly correlated with `m6_p_earning_days` and 7 other fields	High correlation
`m3_con_rise_days` is highly correlated with `m6_con_rise_days` and 1 other fields	High correlation
`m3_con_fall_days` is highly correlated with `m3_n_earning_days` and 1 other fields	High correlation
`y1_p_earning_days` is highly correlated with `m6_p_earning_days` and 6 other fields	High correlation
`m3_n_earning_days` is highly correlated with `m6_p_earning_days` and 7 other fields	High correlation
`total_n_earning_days` is highly correlated with `m6_p_earning_days` and 6 other fields	High correlation
`total_p_earning_days` is highly correlated with `m6_p_earning_days` and 6 other fields	High correlation
`y1_n_earning_days` is highly correlated with `m6_p_earning_days` and 7 other fields	High correlation
`total_mdd_time` is highly correlated with `m6_mdd_time`	High correlation
`m6_p_earning_days` is highly correlated with `m6_con_rise_days` and 3 other fields	High correlation
`m6_mdd_time` is highly correlated with `total_mdd_time`	High correlation
`m6_con_rise_days` is highly correlated with `m6_p_earning_days` and 3 other fields	High correlation
`m3_p_earning_days` is highly correlated with `m6_p_earning_days` and 3 other fields	High correlation
`m3_con_rise_days` is highly correlated with `m6_p_earning_days` and 3 other fields	High correlation
`m3_con_fall_days` is highly correlated with `m3_n_earning_days`	High correlation
`y1_p_earning_days` is highly correlated with `m6_p_earning_days` and 2 other fields	High correlation
`m3_n_earning_days` is highly correlated with `m3_p_earning_days` and 2 other fields	High correlation
`total_con_fall_days` is highly correlated with `total_n_earning_days`	High correlation
`total_n_earning_days` is highly correlated with `total_con_fall_days` and 1 other fields	High correlation
`total_p_earning_days` is highly correlated with `total_n_earning_days`	High correlation
`y1_n_earning_days` is highly correlated with `y1_p_earning_days`	High correlation
`m6_p_earning_days` is highly correlated with `m6_con_rise_days` and 9 other fields	High correlation
`m6_mdd_time` is highly correlated with `m3_con_fall_days` and 2 other fields	High correlation
`m6_con_rise_days` is highly correlated with `m6_p_earning_days` and 4 other fields	High correlation
`year_p_earning_days` is highly correlated with `m6_p_earning_days` and 9 other fields	High correlation
`m3_p_earning_days` is highly correlated with `m6_p_earning_days` and 9 other fields	High correlation
`m3_con_rise_days` is highly correlated with `m6_p_earning_days` and 6 other fields	High correlation
`m3_con_fall_days` is highly correlated with `m6_p_earning_days` and 8 other fields	High correlation
`y1_p_earning_days` is highly correlated with `m6_p_earning_days` and 9 other fields	High correlation
`m3_n_earning_days` is highly correlated with `m6_p_earning_days` and 8 other fields	High correlation
`total_n_earning_days` is highly correlated with `m6_p_earning_days` and 8 other fields	High correlation
`total_p_earning_days` is highly correlated with `m6_p_earning_days` and 7 other fields	High correlation
`y1_n_earning_days` is highly correlated with `m6_p_earning_days` and 9 other fields	High correlation
`total_mdd_time` has 800 (2.9%) missing values	Missing
`m6_p_earning_days` has 1313 (4.7%) missing values	Missing
`m6_mdd_time` has 2336 (8.4%) missing values	Missing
`m6_con_rise_days` has 1309 (4.7%) missing values	Missing
`year_p_earning_days` has 597 (2.2%) missing values	Missing
`m3_p_earning_days` has 684 (2.5%) missing values	Missing
`m3_con_rise_days` has 698 (2.5%) missing values	Missing
`m3_con_fall_days` has 698 (2.5%) missing values	Missing
`y1_p_earning_days` has 2544 (9.2%) missing values	Missing
`m3_n_earning_days` has 705 (2.5%) missing values	Missing
`total_con_fall_days` has 317 (1.1%) missing values	Missing
`y1_n_earning_days` has 2544 (9.2%) missing values	Missing
`m6_con_rise_days` is highly skewed (γ1 = 25.42038884)	Skewed
`df_index` has unique values	Unique
`m6_con_rise_days` has 3438 (12.4%) zeros	Zeros
`year_p_earning_days` has 1958 (7.1%) zeros	Zeros
`m3_p_earning_days` has 1612 (5.8%) zeros	Zeros
`m3_con_rise_days` has 6342 (22.8%) zeros	Zeros
`m3_con_fall_days` has 7879 (28.4%) zeros	Zeros
`m3_n_earning_days` has 3535 (12.7%) zeros	Zeros
`total_con_fall_days` has 1012 (3.6%) zeros	Zeros
`total_n_earning_days` has 617 (2.2%) zeros	Zeros
`y1_n_earning_days` has 542 (2.0%) zeros	Zeros

Reproduction

Analysis started	2022-02-26 05:19:20.305286
Analysis finished	2022-02-26 05:20:16.731475
Duration	56.43 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	27763
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	36060.18557

Minimum	0
Maximum	50881
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	20265.1
Q1	29600.5
median	36610
Q3	43780.5
95-th percentile	49400.9
Maximum	50881
Range	50881
Interquartile range (IQR)	14180

Descriptive statistics

Standard deviation	9541.487092
Coefficient of variation (CV)	0.2645989459
Kurtosis	0.8495181619
Mean	36060.18557
Median Absolute Deviation (MAD)	7090
Skewness	-0.7415035061
Sum	1001138932
Variance	91039975.92
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
41405	1	< 0.1%
41416	1	< 0.1%
41415	1	< 0.1%
41414	1	< 0.1%
41413	1	< 0.1%
41412	1	< 0.1%
41411	1	< 0.1%
41410	1	< 0.1%
41409	1	< 0.1%
Other values (27753)	27753	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
50881	1	< 0.1%
50880	1	< 0.1%
50879	1	< 0.1%
50878	1	< 0.1%
50877	1	< 0.1%
50876	1	< 0.1%
50875	1	< 0.1%
50874	1	< 0.1%
50873	1	< 0.1%
50872	1	< 0.1%

ret
Real number (ℝ)

Distinct	27145
Distinct (%)	97.8%
Missing	0
Missing (%)	0.0%
Infinite	1
Infinite (%)	< 0.1%
Mean	inf

Minimum	-1
Maximum	inf
Zeros	152
Zeros (%)	0.5%
Negative	12060
Negative (%)	43.4%
Memory size	217.0 KiB

Quantile statistics

Minimum	-1
5-th percentile	-0.0763686769
Q1	-0.02436475742
median	0.004107197864
Q3	0.03229871349
95-th percentile	0.09133561216
Maximum	inf
Range	inf
Interquartile range (IQR)	0.0566634709

Descriptive statistics

Standard deviation	nan
Coefficient of variation (CV)	nan
Kurtosis	nan
Mean	inf
Median Absolute Deviation (MAD)	0.02835456829
Skewness	nan
Sum	inf
Variance	nan
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	152	0.5%
0.02272727273	6	< 0.1%
-0.04166666667	5	< 0.1%
0.02083333333	5	< 0.1%
0.004484304933	4	< 0.1%
0.03448275862	4	< 0.1%
0.03703703704	4	< 0.1%
0.002766251729	4	< 0.1%
0.01162790698	4	< 0.1%
-0.004651162791	3	< 0.1%
Other values (27135)	27572	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-1	1	< 0.1%
-0.7789013392	1	< 0.1%
-0.5508322087	1	< 0.1%
-0.3916904921	1	< 0.1%
-0.3880993645	1	< 0.1%
-0.382441371	1	< 0.1%
-0.3762376238	1	< 0.1%
-0.3722631579	1	< 0.1%
-0.3393691589	1	< 0.1%
-0.3149746541	1	< 0.1%

Value	Count	Frequency (%)
inf	1	< 0.1%
1.312039312	1	< 0.1%
1.306273063	1	< 0.1%
1.211337643	1	< 0.1%
0.9879497908	1	< 0.1%
0.5598455598	1	< 0.1%
0.4450338933	1	< 0.1%
0.4031620553	1	< 0.1%
0.3996082272	1	< 0.1%
0.3965014577	1	< 0.1%

total_mdd_time
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	313
Distinct (%)	1.2%
Missing	800
Missing (%)	2.9%
Infinite	0
Infinite (%)	0.0%
Mean	379.0711716

Minimum	1
Maximum	4079
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	10
median	214
Q3	397
95-th percentile	1310
Maximum	4079
Range	4078
Interquartile range (IQR)	387

Descriptive statistics

Standard deviation	491.4174843
Coefficient of variation (CV)	1.29637261
Kurtosis	0.5403024179
Mean	379.0711716
Median Absolute Deviation (MAD)	204
Skewness	1.318165848
Sum	10220896
Variance	241491.1438
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9	3325	12.0%
1310	2195	7.9%
274	2166	7.8%
305	1033	3.7%
31	949	3.4%
334	913	3.3%
10	889	3.2%
91	856	3.1%
1341	593	2.1%
8	523	1.9%
Other values (303)	13521	48.7%
(Missing)	800	2.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	514	1.9%
2	517	1.9%
3	278	1.0%
4	316	1.1%
5	183	0.7%
6	106	0.4%
7	362	1.3%
8	523	1.9%
9	3325	12.0%
10	889	3.2%

Value	Count	Frequency (%)
4079	3	< 0.1%
2953	5	< 0.1%
2345	1	< 0.1%
2253	7	< 0.1%
1889	11	< 0.1%
1858	17	0.1%
1827	16	0.1%
1797	34	0.1%
1796	22	0.1%
1766	38	0.1%

m6_p_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	67
Distinct (%)	0.3%
Missing	1313
Missing (%)	4.7%
Infinite	0
Infinite (%)	0.0%
Mean	5.017429112

Minimum	0
Maximum	125
Zeros	239
Zeros (%)	0.9%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	3
median	4
Q3	5
95-th percentile	6
Maximum	125
Range	125
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	8.171479143
Coefficient of variation (CV)	1.628618753
Kurtosis	48.3280023
Mean	5.017429112
Median Absolute Deviation (MAD)	1
Skewness	6.719541114
Sum	132711
Variance	66.77307139
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4	6878	24.8%
5	5639	20.3%
3	5609	20.2%
2	2986	10.8%
6	2803	10.1%
1	1335	4.8%
7	377	1.4%
0	239	0.9%
53	50	0.2%
64	34	0.1%
Other values (57)	500	1.8%
(Missing)	1313	4.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	239	0.9%
1	1335	4.8%
2	2986	10.8%
3	5609	20.2%
4	6878	24.8%
5	5639	20.3%
6	2803	10.1%
7	377	1.4%
10	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
125	3	< 0.1%
124	2	< 0.1%
121	1	< 0.1%
77	2	< 0.1%
76	2	< 0.1%
75	3	< 0.1%
74	1	< 0.1%
73	1	< 0.1%
72	1	< 0.1%
71	4	< 0.1%

m6_mdd_time
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	102
Distinct (%)	0.4%
Missing	2336
Missing (%)	8.4%
Infinite	0
Infinite (%)	0.0%
Mean	47.96527313

Minimum	1
Maximum	215
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	5
median	31
Q3	61
95-th percentile	153
Maximum	215
Range	214
Interquartile range (IQR)	56

Descriptive statistics

Standard deviation	50.33914023
Coefficient of variation (CV)	1.04949137
Kurtosis	1.655289342
Mean	47.96527313
Median Absolute Deviation (MAD)	29
Skewness	1.39774565
Sum	1219613
Variance	2534.029039
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
31	3786	13.6%
61	3244	11.7%
1	2708	9.8%
30	2002	7.2%
5	1603	5.8%
2	1582	5.7%
92	1258	4.5%
3	1214	4.4%
6	1074	3.9%
91	960	3.5%
Other values (92)	5996	21.6%
(Missing)	2336	8.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2708	9.8%
2	1582	5.7%
3	1214	4.4%
4	540	1.9%
5	1603	5.8%
6	1074	3.9%
7	2	< 0.1%
13	8	< 0.1%
14	6	< 0.1%
15	1	< 0.1%

Value	Count	Frequency (%)
215	258	0.9%
214	204	0.7%
213	15	0.1%
212	47	0.2%
184	319	1.1%
183	69	0.2%
182	16	0.1%
181	55	0.2%
180	2	< 0.1%
171	1	< 0.1%

m6_con_rise_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
SKEWED
ZEROS

Distinct	18
Distinct (%)	0.1%
Missing	1309
Missing (%)	4.7%
Infinite	0
Infinite (%)	0.0%
Mean	2.61907462

Minimum	0
Maximum	125
Zeros	3438
Zeros (%)	12.4%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	2
median	3
Q3	3
95-th percentile	6
Maximum	125
Range	125
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	2.36567791
Coefficient of variation (CV)	0.9032495261
Kurtosis	1223.894275
Mean	2.61907462
Median Absolute Deviation (MAD)	1
Skewness	25.42038884
Sum	69285
Variance	5.596431972
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
2	7833	28.2%
3	6937	25.0%
4	3491	12.6%
0	3438	12.4%
1	1892	6.8%
5	1524	5.5%
6	845	3.0%
7	458	1.6%
8	17	0.1%
9	5	< 0.1%
Other values (8)	14	0.1%
(Missing)	1309	4.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3438	12.4%
1	1892	6.8%
2	7833	28.2%
3	6937	25.0%
4	3491	12.6%
5	1524	5.5%
6	845	3.0%
7	458	1.6%
8	17	0.1%
9	5	< 0.1%

Value	Count	Frequency (%)
125	3	< 0.1%
120	1	< 0.1%
106	1	< 0.1%
74	1	< 0.1%
48	3	< 0.1%
14	1	< 0.1%
11	2	< 0.1%
10	2	< 0.1%
9	5	< 0.1%
8	17	0.1%

year_p_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	105
Distinct (%)	0.4%
Missing	597
Missing (%)	2.2%
Infinite	0
Infinite (%)	0.0%
Mean	5.169586984

Minimum	0
Maximum	245
Zeros	1958
Zeros (%)	7.1%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	2
median	3
Q3	6
95-th percentile	9
Maximum	245
Range	245
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	11.93959228
Coefficient of variation (CV)	2.3095834
Kurtosis	91.51893328
Mean	5.169586984
Median Absolute Deviation (MAD)	2
Skewness	8.830582264
Sum	140437
Variance	142.5538639
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	4228	15.2%
3	3796	13.7%
2	3741	13.5%
4	3369	12.1%
5	2746	9.9%
6	2543	9.2%
0	1958	7.1%
7	1894	6.8%
8	1284	4.6%
9	655	2.4%
Other values (95)	952	3.4%
(Missing)	597	2.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1958	7.1%
1	4228	15.2%
2	3741	13.5%
3	3796	13.7%
4	3369	12.1%
5	2746	9.9%
6	2543	9.2%
7	1894	6.8%
8	1284	4.6%
9	655	2.4%

Value	Count	Frequency (%)
245	1	< 0.1%
244	2	< 0.1%
243	2	< 0.1%
144	1	< 0.1%
136	1	< 0.1%
129	2	< 0.1%
126	1	< 0.1%
125	1	< 0.1%
124	3	< 0.1%
123	2	< 0.1%

m3_p_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	40
Distinct (%)	0.1%
Missing	684
Missing (%)	2.5%
Infinite	0
Infinite (%)	0.0%
Mean	2.670298017

Minimum	0
Maximum	61
Zeros	1612
Zeros (%)	5.8%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	61
Range	61
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	4.017983527
Coefficient of variation (CV)	1.504694795
Kurtosis	46.94328397
Mean	2.670298017
Median Absolute Deviation (MAD)	1
Skewness	6.482534628
Sum	72309
Variance	16.14419162
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=40)

Value	Count	Frequency (%)
2	9188	33.1%
3	8005	28.8%
1	5760	20.7%
4	1934	7.0%
0	1612	5.8%
26	79	0.3%
29	70	0.3%
27	54	0.2%
25	51	0.2%
28	48	0.2%
Other values (30)	278	1.0%
(Missing)	684	2.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1612	5.8%
1	5760	20.7%
2	9188	33.1%
3	8005	28.8%
4	1934	7.0%
5	2	< 0.1%
6	1	< 0.1%
10	2	< 0.1%
11	1	< 0.1%
12	4	< 0.1%

Value	Count	Frequency (%)
61	6	< 0.1%
43	3	< 0.1%
42	2	< 0.1%
41	1	< 0.1%
40	1	< 0.1%
39	3	< 0.1%
37	5	< 0.1%
36	4	< 0.1%
35	17	0.1%
34	14	0.1%

m3_con_rise_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	698
Missing (%)	2.5%
Infinite	0
Infinite (%)	0.0%
Mean	1.730980972

Minimum	0
Maximum	61
Zeros	6342
Zeros (%)	22.8%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	61
Range	61
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.573411398
Coefficient of variation (CV)	0.9089709384
Kurtosis	444.9442815
Mean	1.730980972
Median Absolute Deviation (MAD)	1
Skewness	12.06608929
Sum	46849
Variance	2.475623428
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
2	8373	30.2%
0	6342	22.8%
1	5098	18.4%
3	4809	17.3%
4	2203	7.9%
5	104	0.4%
7	71	0.3%
6	49	0.2%
8	6	< 0.1%
61	6	< 0.1%
Other values (3)	4	< 0.1%
(Missing)	698	2.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	6342	22.8%
1	5098	18.4%
2	8373	30.2%
3	4809	17.3%
4	2203	7.9%
5	104	0.4%
6	49	0.2%
7	71	0.3%
8	6	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
61	6	< 0.1%
11	2	< 0.1%
10	1	< 0.1%
9	1	< 0.1%
8	6	< 0.1%
7	71	0.3%
6	49	0.2%
5	104	0.4%
4	2203	7.9%
3	4809	17.3%

m3_con_fall_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	12
Distinct (%)	< 0.1%
Missing	698
Missing (%)	2.5%
Infinite	0
Infinite (%)	0.0%
Mean	1.265102531

Minimum	0
Maximum	11
Zeros	7879
Zeros (%)	28.4%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	2
95-th percentile	3
Maximum	11
Range	11
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.178636713
Coefficient of variation (CV)	0.9316531144
Kurtosis	4.774458054
Mean	1.265102531
Median Absolute Deviation (MAD)	1
Skewness	1.483998006
Sum	34240
Variance	1.389184501
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
1	8951	32.2%
0	7879	28.4%
2	7048	25.4%
3	2534	9.1%
4	229	0.8%
7	162	0.6%
6	138	0.5%
5	99	0.4%
8	13	< 0.1%
9	7	< 0.1%
Other values (2)	5	< 0.1%
(Missing)	698	2.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	7879	28.4%
1	8951	32.2%
2	7048	25.4%
3	2534	9.1%
4	229	0.8%
5	99	0.4%
6	138	0.5%
7	162	0.6%
8	13	< 0.1%
9	7	< 0.1%

Value	Count	Frequency (%)
11	1	< 0.1%
10	4	< 0.1%
9	7	< 0.1%
8	13	< 0.1%
7	162	0.6%
6	138	0.5%
5	99	0.4%
4	229	0.8%
3	2534	9.1%
2	7048	25.4%

y1_p_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	115
Distinct (%)	0.5%
Missing	2544
Missing (%)	9.2%
Infinite	0
Infinite (%)	0.0%
Mean	9.692255839

Minimum	0
Maximum	245
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	4
Q1	6
median	7
Q3	9
95-th percentile	11
Maximum	245
Range	245
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	16.29161715
Coefficient of variation (CV)	1.680890128
Kurtosis	47.66377097
Mean	9.692255839
Median Absolute Deviation (MAD)	1
Skewness	6.761665085
Sum	244429
Variance	265.4167895
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7	4728	17.0%
8	4711	17.0%
9	3720	13.4%
6	3565	12.8%
5	2431	8.8%
10	1899	6.8%
4	1398	5.0%
11	687	2.5%
3	647	2.3%
12	392	1.4%
Other values (105)	1041	3.7%
(Missing)	2544	9.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	63	0.2%
2	196	0.7%
3	647	2.3%
4	1398	5.0%
5	2431	8.8%
6	3565	12.8%
7	4728	17.0%
8	4711	17.0%
9	3720	13.4%

Value	Count	Frequency (%)
245	1	< 0.1%
244	2	< 0.1%
243	2	< 0.1%
174	3	< 0.1%
144	1	< 0.1%
141	1	< 0.1%
140	4	< 0.1%
139	6	< 0.1%
138	1	< 0.1%
137	3	< 0.1%

m3_n_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	32
Distinct (%)	0.1%
Missing	705
Missing (%)	2.5%
Infinite	0
Infinite (%)	0.0%
Mean	2.115529603

Minimum	0
Maximum	40
Zeros	3535
Zeros (%)	12.7%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	2
95-th percentile	3
Maximum	40
Range	40
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	4.25032954
Coefficient of variation (CV)	2.009108988
Kurtosis	43.23722864
Mean	2.115529603
Median Absolute Deviation (MAD)	1
Skewness	6.493152273
Sum	57242
Variance	18.0653012
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=32)

Value	Count	Frequency (%)
1	9665	34.8%
2	9426	34.0%
3	3761	13.5%
0	3535	12.7%
4	107	0.4%
35	60	0.2%
29	54	0.2%
31	44	0.2%
34	43	0.2%
28	43	0.2%
Other values (22)	320	1.2%
(Missing)	705	2.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3535	12.7%
1	9665	34.8%
2	9426	34.0%
3	3761	13.5%
4	107	0.4%
5	2	< 0.1%
6	1	< 0.1%
10	1	< 0.1%
11	2	< 0.1%
18	1	< 0.1%

Value	Count	Frequency (%)
40	2	< 0.1%
39	7	< 0.1%
38	7	< 0.1%
37	19	0.1%
36	31	0.1%
35	60	0.2%
34	43	0.2%
33	26	0.1%
32	42	0.2%
31	44	0.2%

total_con_fall_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	15
Distinct (%)	0.1%
Missing	317
Missing (%)	1.1%
Infinite	0
Infinite (%)	0.0%
Mean	4.247176273

Minimum	0
Maximum	43
Zeros	1012
Zeros (%)	3.6%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	3
median	4
Q3	5
95-th percentile	7
Maximum	43
Range	43
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.859886712
Coefficient of variation (CV)	0.4379113538
Kurtosis	7.715732093
Mean	4.247176273
Median Absolute Deviation (MAD)	1
Skewness	0.5239983841
Sum	116568
Variance	3.459178581
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=15)

Value	Count	Frequency (%)
4	7450	26.8%
5	7277	26.2%
3	4317	15.5%
7	2973	10.7%
2	1980	7.1%
0	1012	3.6%
1	898	3.2%
6	696	2.5%
8	342	1.2%
9	336	1.2%
Other values (5)	165	0.6%
(Missing)	317	1.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1012	3.6%
1	898	3.2%
2	1980	7.1%
3	4317	15.5%
4	7450	26.8%
5	7277	26.2%
6	696	2.5%
7	2973	10.7%
8	342	1.2%
9	336	1.2%

Value	Count	Frequency (%)
43	1	< 0.1%
13	5	< 0.1%
12	43	0.2%
11	43	0.2%
10	73	0.3%
9	336	1.2%
8	342	1.2%
7	2973	10.7%
6	696	2.5%
5	7277	26.2%

total_n_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	501
Distinct (%)	1.8%
Missing	234
Missing (%)	0.8%
Infinite	0
Infinite (%)	0.0%
Mean	39.48512478

Minimum	0
Maximum	1885
Zeros	617
Zeros (%)	2.2%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	12
median	27
Q3	43
95-th percentile	66
Maximum	1885
Range	1885
Interquartile range (IQR)	31

Descriptive statistics

Standard deviation	98.51859604
Coefficient of variation (CV)	2.495081289
Kurtosis	102.6855348
Mean	39.48512478
Median Absolute Deviation (MAD)	15
Skewness	9.39093323
Sum	1086986
Variance	9705.913766
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	626	2.3%
0	617	2.2%
11	617	2.2%
10	597	2.2%
12	586	2.1%
13	580	2.1%
2	557	2.0%
26	538	1.9%
9	531	1.9%
33	527	1.9%
Other values (491)	21753	78.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	617	2.2%
1	626	2.3%
2	557	2.0%
3	475	1.7%
4	473	1.7%
5	454	1.6%
6	476	1.7%
7	502	1.8%
8	522	1.9%
9	531	1.9%

Value	Count	Frequency (%)
1885	1	< 0.1%
1867	1	< 0.1%
1821	1	< 0.1%
1763	1	< 0.1%
1745	1	< 0.1%
1683	1	< 0.1%
1647	1	< 0.1%
1600	1	< 0.1%
1573	1	< 0.1%
1556	1	< 0.1%

total_p_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	546
Distinct (%)	2.0%
Missing	103
Missing (%)	0.4%
Infinite	0
Infinite (%)	0.0%
Mean	48.20195228

Minimum	0
Maximum	2095
Zeros	158
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	4
Q1	16
median	33
Q3	53
95-th percentile	88
Maximum	2095
Range	2095
Interquartile range (IQR)	37

Descriptive statistics

Standard deviation	109.3305179
Coefficient of variation (CV)	2.268176137
Kurtosis	99.23915242
Mean	48.20195228
Median Absolute Deviation (MAD)	18
Skewness	9.146921408
Sum	1333266
Variance	11953.16215
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14	570	2.1%
15	566	2.0%
12	563	2.0%
11	561	2.0%
13	541	1.9%
16	536	1.9%
17	535	1.9%
18	511	1.8%
10	491	1.8%
19	486	1.8%
Other values (536)	22300	80.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	158	0.6%
1	409	1.5%
2	376	1.4%
3	340	1.2%
4	391	1.4%
5	382	1.4%
6	366	1.3%
7	345	1.2%
8	365	1.3%
9	452	1.6%

Value	Count	Frequency (%)
2095	1	< 0.1%
2007	1	< 0.1%
1999	1	< 0.1%
1976	1	< 0.1%
1882	1	< 0.1%
1877	1	< 0.1%
1855	1	< 0.1%
1844	1	< 0.1%
1806	1	< 0.1%
1749	1	< 0.1%

y1_n_earning_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	106
Distinct (%)	0.4%
Missing	2544
Missing (%)	9.2%
Infinite	0
Infinite (%)	0.0%
Mean	7.74539038

Minimum	0
Maximum	143
Zeros	542
Zeros (%)	2.0%
Negative	0
Negative (%)	0.0%
Memory size	217.0 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	4
median	5
Q3	7
95-th percentile	9
Maximum	143
Range	143
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	16.68447556
Coefficient of variation (CV)	2.154116802
Kurtosis	43.24684931
Mean	7.74539038
Median Absolute Deviation (MAD)	1
Skewness	6.629690539
Sum	195331
Variance	278.3717246
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5	5110	18.4%
6	4500	16.2%
4	4248	15.3%
7	3138	11.3%
3	2448	8.8%
8	1926	6.9%
9	1058	3.8%
2	919	3.3%
0	542	2.0%
10	389	1.4%
Other values (96)	941	3.4%
(Missing)	2544	9.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	542	2.0%
1	287	1.0%
2	919	3.3%
3	2448	8.8%
4	4248	15.3%
5	5110	18.4%
6	4500	16.2%
7	3138	11.3%
8	1926	6.9%
9	1058	3.8%

Value	Count	Frequency (%)
143	1	< 0.1%
142	2	< 0.1%
140	3	< 0.1%
139	4	< 0.1%
138	2	< 0.1%
137	6	< 0.1%
136	12	< 0.1%
135	9	< 0.1%
134	13	< 0.1%
133	22	0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	ret	total_mdd_time	m6_p_earning_days	m6_mdd_time	m6_con_rise_days	year_p_earning_days	m3_p_earning_days	m3_con_rise_days	m3_con_fall_days	y1_p_earning_days	m3_n_earning_days	total_con_fall_days	total_n_earning_days	total_p_earning_days	y1_n_earning_days
0	0	0.035794	230.0	66.0	49.0	6.0	9.0	32.0	5.0	5.0	133.0	30.0	6.0	392.0	522.0	109.0
1	1	-0.003764	230.0	62.0	49.0	5.0	21.0	31.0	5.0	5.0	135.0	26.0	6.0	397.0	534.0	108.0
2	2	-0.028563	230.0	63.0	49.0	5.0	33.0	33.0	5.0	5.0	134.0	25.0	6.0	408.0	546.0	109.0
3	3	-0.057333	230.0	65.0	49.0	5.0	42.0	33.0	5.0	7.0	135.0	25.0	7.0	417.0	555.0	106.0
4	4	0.054007	230.0	59.0	42.0	5.0	49.0	28.0	5.0	7.0	132.0	33.0	7.0	430.0	562.0	108.0
5	5	0.025027	230.0	65.0	51.0	6.0	65.0	32.0	6.0	7.0	135.0	28.0	7.0	436.0	578.0	107.0
6	6	0.026036	230.0	70.0	51.0	6.0	79.0	37.0	6.0	4.0	136.0	26.0	7.0	443.0	592.0	106.0
7	7	0.020582	230.0	71.0	51.0	6.0	92.0	43.0	6.0	3.0	133.0	23.0	7.0	453.0	605.0	109.0
8	8	-0.005967	230.0	71.0	51.0	6.0	104.0	39.0	6.0	3.0	134.0	26.0	7.0	462.0	617.0	109.0
9	9	-0.042577	230.0	70.0	30.0	6.0	112.0	33.0	6.0	4.0	135.0	28.0	7.0	471.0	625.0	109.0

Last rows

	df_index	ret	total_mdd_time	m6_p_earning_days	m6_mdd_time	m6_con_rise_days	year_p_earning_days	m3_p_earning_days	m3_con_rise_days	m3_con_fall_days	y1_p_earning_days	m3_n_earning_days	total_con_fall_days	total_n_earning_days	total_p_earning_days	y1_n_earning_days
27753	50872	0.027422	274.0	5.0	59.0	4.0	2.0	2.0	1.0	2.0	10.0	2.0	6.0	43.0	63.0	3.0
27754	50873	-0.000890	274.0	5.0	59.0	3.0	3.0	2.0	2.0	2.0	10.0	2.0	6.0	43.0	64.0	3.0
27755	50874	-0.053874	274.0	4.0	59.0	2.0	3.0	2.0	2.0	1.0	9.0	2.0	6.0	44.0	64.0	4.0
27756	50875	-0.022588	274.0	3.0	181.0	2.0	3.0	2.0	2.0	2.0	8.0	2.0	6.0	45.0	64.0	5.0
27757	50876	0.019740	274.0	2.0	212.0	2.0	3.0	1.0	1.0	3.0	7.0	3.0	6.0	46.0	64.0	6.0
27758	50877	0.008026	274.0	3.0	92.0	2.0	4.0	1.0	1.0	3.0	7.0	3.0	6.0	46.0	65.0	6.0
27759	50878	-0.005621	274.0	4.0	92.0	2.0	5.0	2.0	2.0	2.0	8.0	2.0	6.0	46.0	66.0	5.0
27760	50879	0.017899	274.0	3.0	92.0	2.0	5.0	2.0	2.0	1.0	7.0	2.0	6.0	47.0	66.0	6.0
27761	50880	-0.073577	274.0	3.0	92.0	2.0	6.0	3.0	2.0	1.0	7.0	1.0	6.0	47.0	67.0	6.0
27762	50881	0.000000	274.0	3.0	215.0	2.0	0.0	2.0	1.0	1.0	6.0	2.0	6.0	48.0	67.0	7.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows